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Abstract 



Let (Q, J?, P) be a probability space and 5 = {Si, ... , Sk} a discrete-topological space that con- 
sists of K real d-by-d matrices, where K and d both > 2. In this paper, we study the pointwise 
stabilizability of a discrete-time, time-homogeneous, stationary (p, i > )-Markovian jump linear 
system 3 = (^n)„=\ where £„ : Q — > S. Precisely, S is called "pointwise convergent", if to any 
0^ , initial state xo G K lxrf , there corresponds a measurable set Q Xo c Q with P(Q Xo ) > such that 

Ph #| 
<-< I ^U ^f(w) -» lxd asn->+oo, Vwefij 



and 3 is said to be "pointwise exponentially convergent", if to any initial state xq e M. lxd , there 
corresponds a measurable set Q' c Q with ¥(Qf ) > such that 

nn exponentially fast 
j&(w) > Oixd as«^+oo, Vwefl,.. 

Using dichotomy, we show that if 3 is product bounded, i.e., 3/3 > such that 

llIJ"_ ^fMlb < P V« > 1 and P-a.e. to e Q; 
then 3 is pointwise convergent if and only if it is pointwise exponentially convergent. 
Keywords: Markovian jump linear system, pointwise stabilization, random products of matrices 
2010MSC: Primary 61J10, 93C05; Secondary 37N35, 93D20, 93A30. 

1. Introduction 

1.1. Motivations 

Let S = {Si, ... , Sk} be a set that consists of K real d x d matrices, where K and d both are 
integers with 2 < K < oo and 2 < d < oo. The system 5 is said to be 
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1 INTRODUCTION 2 

• "pointwise convergent" if for each x e W lxd , there is an infinite switching sequence 
i.(x): N -> { 1 , . . . , K) such that lim„^ +0O x JJLi S/ tW = (W; 

• "pointwise exponentially convergent" if for each ;t e R lxd , there is a switching sequence 
i. (x) : N -> {1, . . . , K} such that lim sup„_ +00 ± log ||x T]Li S, tW || 2 < 0. 

Here and in the sequel, N = {1, 2, . . . } is the natural number set, O^xd, stands for the origin of 
R d]Xdl , and || • H2 denotes the usual euclidean norm on M lxrf defined by ||x||2 = Vxx T for any 
row- vector x e M. lxd . 

It is clear that the notion of "convergence" here is abused as it is referring to the usual ap- 
proach to "convergence" in the stability theory that requires convergence taking place for any (or 
almost any) switching sequences i. = (i n )^=i ■ Here convergence takes place only for some index 
sequence i.(x). 

Further, S is said to be 

• "consistently convergent" (also called "uniformly convergent" in, for example, [42, 13]), 
if the switching sequence i.(x) in the pointwise convergence can be taken independent of 
the initial state x; that is to say, there exists a switching sequence i. : N — > {1, . . . ,K] such 
that lim„^ +00 JlLi S4 = dX d- 

These concepts arise and have been studied naturally in the theory of multi-rate sampled- 
data control systems and multi-modal linear control systems and for some control optimization 
problems in, for example, [41, 6, 42, 19, 13, 43, 44, 30, 31, 15]. 

It is worth to remark that instead of the euclidean norm || • H2 here can be considered any 
vector norm ont lx ' i . 

In this paper, we consider the random version of the above important concepts driven by 
stationary Markov chains. Let (Q., &, P) be a probability space and let 

S = (&)£, wherein-* {i,...,a:j, 

be a discrete-time, time-homogeneous, stationary (p, i > )-Markov chain, which naturally induces 
a "Markovian jump linear system" based on 5 as follows: 1 

x„ - *oSft(e») ■ ■ • Sf„( w ), x e R lxd , n>l,a>&Q.. 

Here p - (p u . . .,Pk) e M. lxK is the initial distribution and P - [ptj] e R KxK is the Markov 
transition probability matrix of S with pP - p. 

To any sample to € Q, there corresponds a switching sequence E(w) = {^„{co))^ that is 
named a "trajectory" of the Markov chain S in the textbooks of stochastic processes. Moreover, 
for any switching sequence i. - (in)„=i> there need not be some sample a> satisfying %„{u>) = i„ for 
all n > 1 . However, in the situation of probability peoples are only concerned with the events of 
positive-probability. So, motivated by the above notations, we introduce the following concepts. 

Definition 1.1. The Markovian jump linear system (S, 3) is called to be 



1 In almost all available literature, peoples directly consider the linear Markovian process 

H = (£„)„> 1, where f„: CI — > S instead of f„ : fl — > jl, . . . ,K), 

as formulated in Abstract. This looks more concise. However, our treatment presented here enables us to employ the 
abstract theory of symbolic dynamical systems. See Section 2 below. 
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(a) "pointwise convergent", if to any initial state xq g M. lxd , there corresponds a measurable 

subset Q. ro c Q with P(Q Ao ) > such that 

xo JJSgt&j) -» 0i x </ as « -> +00, Vw e O^ ; 
k=\ 

(b) "pointwise exponentially convergent", if to any initial state xo e R lx '', there corresponds a 

measurable subset Q' c Q with P(Q' ) > such that 



1 " 

lim sup - log I |*o Y[ S&(4>) I b < 0, Vw e Q; o ; 



fc=i 



(c) "consistently exponentially convergent", if there exists a measurable subset D." c CI with 
P(Q") > such that 



1 " 

lim sup - log || TT S 6M || 2 < 0, Vwe O" 

„ . . _ _ J1 - 1 - - 1 - 



»— k=l 

Here ||A||2 denotes the matrix norm induced by the euclidean vector norm || ■ H2 on IR lxd , 
for any A € R^. 

Here "consistently" only means that the choice of the driving sample co is independent of any 
initial state xq € M. lxd . We should notice that the consistent exponential convergence of (S, S) 
over co is essentially weaker than the so-called "uniform exponential stability" over co: 3C > 
and < y < 1 such that 



I" Sfo^lb < cy" W>0,m>l. 



In addition, since H does not need to be irreducible (or equivalently, not need to be ergodic; see 
Section 2), we cannot require P(Q") = 1 here in general. 

It is obvious that (c) => (b) => (a), but not vice versa in general. 

Remark 1.2. Because considering a deterministic sample co makes no sense in probability theory 
and random/stochastic stability theory, it is necessary to require the property of positive proba- 
bility: P(Q. ro ) > 0, P(fi A . ) > 0, and P(Q") > 0, in Definition 1.1. That means all Q Ao ,Q Ao and 
Q." to be non-negligible events. 

1.2. Main results 

In this paper, we will mainly show in Section 3 a random stabilizability theorem, stated as 
follows. 

Theorem A. Let the Markovian jump linear system (S, S) be product bounded; i.e., there exists 
some p > 1 such that for F-a.e. co e O, 



i]X'%mII2^ v '^ l 



Then, (S, H) is pointwise convergent if and only if it is pointwise exponentially convergent. 
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We notice that if S is irreducible 2 with the joint spectral radius p{S) = 1 (it will be precisely 
defined in Section 3.1.2), then (S, S) is product bounded; see, e.g.,N. Barabanov [3]. The product 
boundedness condition, also named as "Lyapunov stability" in ODE, is both practically important 
and academically challenging [32, 1, 23, 2, 45]. Indeed, it is desirable in many practical issues 
and is closely related to periodic solutions and limit cycles [4, 5]. 

Such an equivalence theorem will play a key role in creating upper bounds, finding conver- 
gence rates and exploiting other basic system properties for Markovian jump linear systems, as 
done in the deterministic case, for example, in [44, 26]. 

To prove Theorem A, we need two important tools. One is the ergodic theory of Markov 
chains established in Section 2. And the other is the following dichotomy decomposition theorem 
(Theorem B), which will be proved in a more general framework in Section 4 (Theorem B'), 
using the classical multiplicative ergodic theorem [37] and the interesting idea of limit-semigroup 
due to D.J. Hartfiel [21, 22] and F. Wirth [49]. 

A vector norm || ■ ||„ on R lxc ' is called a "pre-extremal" norm of S, if its induced matrix 
norm on M. dxd is such that ||S,||* < 1 for all i e {1, . . . , K). If S is product bounded, then such a 
pre-extremal norm always exists; see, for example, [11, 28, 18, 36, 23, 15]. 

Theorem B. Let S be product bounded, i.e., there exists a universal constant /3 > 1 such that for 
anyi: N^ \\,...,K), 

iin" =1 s ^ )||2 - j6 v '^ l 

Then to P-a.e. a> 6 Q, there corresponds a splitting ofM. ixd into subspaces 

WL lxd = E s (aj)(BE c (aj) 
such that u) \-* E s (co) is measurable and that 

lim - log ||xoS fl(w) ■ • • S f „ M || 2 < Vx e E\aj), 

n— >+oo n 

liminf IfoSfifro • • • S &(ft)) |b > Vx € R 1X(/ \ E\co), 

n— >+oo 

and 

lUbSftfoo • • • S f .(o»)||. = ItoH. for n > 1 Vx € E c (u) 

for any pre-extremal norm || • ||* ofS on R lxa '. 

This theorem is of independent interest. It is important, not only to the proof of Theorem A, 
but also to approximation of the joint spectral radius, almost sure partial stability, and extremal 
property of orbits, of 5; for example, see related works in [3, 36, 29, 33, 15]. 

On the other hand, if (5, H) is (non-uniformly) hyperbolic over the sample point to, i.e., the 
central manifold E c (a>) is replaced with the unstable manifold defined as 

E u (oj) = \x e K lx '': lim - log ||xS flM ■ ■ ■ S f „ M || 2 > ol U {<W} 

n->+oo n 



2 The matrix family S is said to be "irreducible" if there are no common, proper, nonempty, and invariant subspaces 
of K ixd , for each member of S. See, e.g., [3]. 
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and 

M lx '' =E\cS)®E u {io), 
then it holds trivially that 



1=1 
since in fact 



liminf ||;to TT S ft((U )||2 > Vx € R lxrf \ E\io), 



l - 

Urn - log ll^o TT S^jlb > V*o e K lxrf \ £ s (w) 



f=l 

from the Lyapunov exponent theory. 3 

However, in our situation, some essential difficulties, see for example, Example 4.6 below, 
come out of the existence of the central manifold E c (cj). So, Theorem B might become an 
intuitive example of systems beyond hyperbolic. 

We will end this paper with concluding remarks in Section 5. 

2. Preliminary ergodic theory of Markov chains 

In this section, we will introduce the grounds of the ergodic theory of stationary Markov 
chains, which will be used in the proofs of our main results — Theorems A and B, presented in 
Sections 3 and 4. 

2.1. Basic notions 

Let S = (£n)n=\ where f„ : Q — > < K, be a discrete-time, time-homogeneous, stationary (p, P)- 
Markov chain, defined on the probability space (Q, &, P) with the finite state-space 

f K = {l,...,K] 

that is equipped with the discrete topology. Notice here that "time-homogeneity" means that the 
transition probabilities, 



\U\ =jUn = i] = Pu Vi, j € <K where P = [ Pij ] € 



s,KxK 



all do not depend upon the time n; and "stationary" means pP = p. This implies that fufoi . . . 
are identically distributed random variables. However, they are not necessarily independent. It is 

easy to see 

P[£l =!!,...,£, =i„] =Pi 1 Pi 1 i i '--Pi K -ih, 



3 Here we only need this simple fact: If two real sequences <p = (ip n ) and t// = (i//„) are such that 



X(<p):= hm -log|</3„| ± xW) '■= lim — log |<A„|, 

n-*+oo n n->+oo n 



then lim„^ + „ - \og\tp„ + i/r„\ = max.{x(<p),X<J/')}- 
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for any words 



{h, . . . ,i n ) zK" :=% x ■ ■ ■ x<K 

of finite-length n > 2. Here the probability vector/; = (pi,. .. ,Pk) £ M. lxK is the initial distribu- 
tion of the Markov chain E, i.e., P[f i -k]-p k for all 1 < k < K. 

2.2. Induced symbolic dynamical systems 

We denote by E K the set of all infinite switching sequences i. : N — > 7C. Here it is convenient 
to place the variables 1,2,... at the subscript position. Then, under the infinite product topology 
that can be generated by the cylinders 

[i' u . . . , i' t ] - {i. € E % | i x = i[,..., k = i't) 

for all ( > 1 and any words (i\ , . . . , i' ( ) e 'K 1 of finite-length I, E % is a compact space as well as 
the one-sided Markov shift 

0+ : E % — > E K ; i. = (in)„=\ •-> i-+i - (Jn+OJTi 

is a continuous, surjective transformation. 
Then, by the joint random variable 

E : O -> E % ; « ■-» S(«) = (£,(o»))S , 

we can obtain a natural probability distribution, called the "(p, i > )-Markovian measure" and write 
as jj p p, on £fe, such that 

a- ■ r> J^i if « = 1; 

[PhPiiii ■ ■ ■ Pin-lin lf » ^ 2 , 

for all cylinder sets [ii, . . . , ?' n ] c 1^. 

It should be noted here that jj p p is not necessarily equal to the infinite product of the initial 
distribution of S, for £i, £j» • • ■ need not be independent each others. 

The following is basic for our arguments later. 

Lemma 2.1. The one-sided Markov shift 9+ : Et K — > E^ preserves the (p, P)-Markovian measure 
P-p,p> that is to say, 



fi p , P (B) = v P ,p°e- + 1 (B) 



for all Borel subsets B C E, 



'/<■ 



Proof. Since the Borel cr-field j^ of E K may be generated by all the cylinder sets [i\, . . . , i„], 
we only need to prove 

p p ,p([iu . . . , /„]) = HpjCO^ih, ■■■, i n ])- 
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In fact, by definition, we have 

H P ,p{[i\,. . . , .'„]) = PhPui 2 ■ ■ -Pi^i,, 

= ^2PkPkiiP>ii2---Pin-i>n 

k 

= tip,p°Ol l ([h,...,in\) 

for all words (i\, . . ., /,,) e 7C" and any n > 1. This completes the proof of Lemma 2.1. □ 

This simple result induces an affirmative answer to this question: Is (^+ n (w))„>i, for any a> 
and I > 1, a trajectory of the Markov process H? In fact, from the discrete topology of 7C" and 

4*00 

5(Q) = P|{(£i(w),...,£,(w)): wenixTCxTCx---, 
we see S(Q) is a Borel subset of ££ with fi p p(S(Q)) = 1; if we let 

+oo 

S-=P|6»; f £-(Q) and Q 0o =£'- 1 (S); 

then p p p{Y) - 1 and so P(Qco) = 1; it is easy to check that for any a> e Q M and any € > 1, 
(^+„ (&->))„> i is still a trajectory of S, i.e., there is some other sample point to' e fioo such that 

(£-(a>'))n>i = (&+„(w))n>i- 

Recall from P. Walters [48] that an invariant probability measure ft of the shift 9 + on E^ is 
called "ergodic" if for B e &x* , the following equality 

fi((0- + \B)\B)U(B\0- + \B)))=O 

implies that/i(B) = 1 orO. 

Then there is a well-known fact. 

Lemma 2.2. The (p, P)-Markovian probability p p p is 6 + -ergodic on Z^ if and only if the tran- 
sition matrix P is irreducible. 

Here the transition probability matrix P is called "irreducible" if for any pair i, j e 7C, there 
is some n = n(i, j) > 1 such that p)"' > 0, where pj? is the (i, j)-th element of the «-time product 
matrix P l . It is worth to mention here that this "irreducibility" has nothing in common with 
"irreducibility" explained to a family of matrices in Footnote 2. 

2.3. Ergodic decomposition of Markovian probability 

Since the Markov transition probability matrix P is not necessarily irreducible in our situa- 
tion, we need to consider the ergodic decomposition of the (p, .P)-Markovian probability p p ,p. 

Hereafter, assume p > 0, i.e., pu > VA: e 7C; otherwise, we only need to replace the 
state-space 7C of the Markov chain 3 with 7C \ \k] if p\ - for some 1 < k < K. 
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A state k e 'K is called "recurrent" for S, if the conditional probability 

F[co eQ:3n f /+oo such that£, f (w) = k\£i = k] = 1. 

If fc e 7C is not recurrent, then it is called "non-recurrent". Two states k\,kq., each accessible to 
the other, i.e, p™} > and p£\ > for some pair m,n> 1, are said to "communicate" and we 
write k\ <~~> k,2- The concept of <^> is an equivalence relation. 

Then according to the classical theory of stochastic processes, for example, [12], there exists 
the following basic partition of the totality of states: 

7C = TCo U <Kx U ■ ■ ■ U nC r 

such that 

• TCo consists of all the non-recurrent states of the Markov chain H; 

• each 7C,, 1 < i < r, is closed and communicative, i.e., for any k, k' e 7C, and k" £ %, we 
have 

k^ >k', p ( £, =0Vn>l. 

Then, based on each component < K I , 1 < i < r, one can define a symbolic system 9+ : J7£ — > Zi , 
where 2^ = {/. : N — > 7C,}. It is easily seen that i™- is closed invariant subspace of E^. 
On the other hand, there hold the following two basic results. 

Lemma 2.3. p Pt p(E^) > 0, for each 1 < i < r. 

Proof. By the closedness of the component 7C, in the basic partition, it is easy to see 

from the definition of p p ,/>. This completes the proof of Lemma 2.3. □ 

Lemma 2.4. "Kq — under the assumption p > 0. In general case, 'Kq — [k: p^ — 0). 

Proof. Suppose, by contradiction, that 7Co + 0. Let k e 'Kq. Then, for the cylinder [k] we 
have fi p ,p([k]) = p k > 0. Applying Poincare's Recurrence Theorem ([48, Theorem 1.4], also see 
Section 4.1 below) to (E^, 9+,p p ,p), we see that there exists a Borel set F c [k] with /i p p(F) = p k 
such that for each i. e F there is a sequence «i < rtz < ■ ■ ■ of natural numbers satisfying z. + „ f € F, 
i.e, i„ [+ \ - k, for each €>l. This implies that k would be a recurrent state for S, a contradiction. 
This proves Lemma 2.4. □ 

Let a,- = p.ppiEL) for 1 < i < r. Then < a, < 1 and a\ + ■ ■ ■ + a, ■ = 1. So, 

E^ = E^ t U • • • U E^ r (mod yU p> />) 

is a measurable, not topological, partition of E^. Define conditional 9 + -invariant probability 
measures p Pt p(- |7C,) on E^ by 

/V(2? \%) = ^ ^ Vfi e £W , 
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for each 1 < i < r. Then, 

Hp,p{-) = amip,p(- \K\) + ■ ■ ■ + a r /J. p ,p(- \%). 

Next, we will show that this is just the ergodic decomposition of p p ,p. 

Theorem 2.5. For each 1 < i < r, p p ,p(- \"Ki) is an ergodic probability measure of0 + , supported 
on the subspace E£. 

Proof. Let Q,- = {a> e Q: 5(u>) e E^ } for each 1 < i < r. Then, 

a = a.! u • • • u ci r (mod P) 

is a measurable partition of Q. Moreover, E^ = (£n\n)^\ is a time-homogeneous, stationary 
Markov chain, defined on the conditional probability space (Q,, ,^\q., , !"(■ \Qd) with the state space 
"7C,. Clearly, its initial distribution is 

Pi = (p kl ,...,p kr )/ai if % = {hi , . . . , kt) 

and its transition probability matrix is 

Pi = [pij] 6 R*** 

which is irreducible from the closedness of the component "7C, in the basic partition of 'K. Thus 
from Lemma 2.2, it follows thalp p p{- \Kj) - fi p .,p. is ergodic of 6 + . 

This completes the proof of Theorem 2.5. □ 

This ergodic decomposition will provide us convenience for proving our main results below. 

Remark 2.6. Since all the 0+ -invariant probabilities form a compact convex set Ai mv {E^,6+) 
and all the # + -ergodic probabilities are just its extreme points, we can directly use the Choquet 
representation theorem to express each member of A1i nv (^-, 8+) in terms of ergodic members. 
See R. Phelps [38]. Hence every p e Aii nv (E^,9+) is a generalised convex combination of 
ergodic probabilities. However, it is important that a (p, P)-Markovian probability p p p has only 
finitely many ergodic components and each component is still a Markovian probability from 
Theorem 2.5. 

3. Pointwise and consistent stabilizability 

This section will be mainly devoted to proving Theorem A stated in Section 1 . In addition, 
we will prove some equivalence between consistent stabilizations. 

LetS = {Si,..., Sir} c W ixd be arbitrarily given K matrices and 7C = [1,...,K], where/: 
and d both > 2. Recall that S is called "product bounded" if the multiplicative semigroup S + , 
generated by S, is bounded in R dxd . This is equivalent to that there exists a constant/? > such 
that for any i. € E^, 

l|S,vS,„||2</8 V«>1. 

We will study the random stabilizability of 5, driven by a discrete-time Markov chain. 

Let S = (^„)^, where £„ : (Q, & , P) — » "7C, be a discrete-time, time-homogeneous, station- 
ary (p, P)-Markov chain, as described in Section 1 . 
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3.1. Pointwise stabilizability: an abstraction of Theorem A 

To prove Theorem A, we consider an abstraction version. For any # + -invariant probability 
measure p on £%,, we say (S, p) to be 

(a)' "pointwise convergent", if to any initial state xq e M lxrf , there corresponds a Borel subset 
E Ao c E^ with yu(£ Vo ) > such that 

n 

x<) JJ S, f -> lxd as « -> +oo, V/. e £, ; 

(b)' "pointwise exponentially convergent", if to any initial state xq e K , there corresponds a 
Borel subset S'. o c 2^ with p(L' Ko ) > such that 



1 " 

lim sup - log ||*o J| S, f || 2 < 0, Vz. e E' Vo 



„-,™ f=i 

Then from Section 2.2 and considering the (p, P)-Markovian probability /j fj f, it follows that the 
statement of Theorem A is true if and only if there holds the following result: 

Theorem 3.1. Let S be product bounded. Then, (S, p p ,p) is pointwise convergent if and only if it 
is pointwise exponentially convergent. 

It should be interesting to notice that for Theorem 3.1, we can require that T,' c Z Ao with 
p p p{Y,' Xa ) — p p p(L Xo ). And a similar requirement can be satisfied for Theorem A. 

We also should note that the deterministic version of Theorem 3.1 was proven by Z. Sun [44, 
Theorem 1]. However, our random version obtained here cannot be derived from Sun's theorem 
and approach because of the requirement of positive probability in Definition 1.1. 

Proof of Theorem A. We only need to prove the necessity. Let (S, S) be pointwise convergent. 
Then from Theorem 2.5, it follows that there exists at least one ergodic component p p ,p(- |7C,) of 
p p P such that (S,p. p p(- \Ki)) is pointwise convergent. Since (S, H) is product bounded, one can 
find a constant j3 > such that 

HS/.---S,„||2<yS Vn>l 

for p p ,p{- ITC^-a.e. i. 6 ££•. On the other hand, the density points of p p ,p(- |7C,) are dense in the 
subspace 2"i; so, S is product bounded over 2^- . Now, Theorem A follows from Theorem 3.1 
with replacing p p j by p pf (- \%). □ 

We need to note here that the product boundedness of (S, S) is weaker than that of S over E^ 
in general, unless the transition probability matrix P is irreducible. 

3.1.1. Proof of Theorem 3.1 

For any 8+ -invariant measure p, the pointwise exponential convergence of (5, p) implies obvi- 
ously the pointwise convergence. Thus, according to the ergodic decomposition (Theorem 2.5), 
Theorem 3.1 follows immediately from the following statement. 

Proposition 3.2. Let S be product bounded and p an ergodic probability measure of6 + on E^. 
If(S,p) is pointwise convergent, then it is pointwise exponentially convergent. 



3 POINTWISE AND CONSISTENT STABILIZABILITY 1 1 

Proof. This statement comes at once from Theorem B that is stated in Section 1 and will be 
proved in Section 4. In fact, let xq e K 1 ^ \ {0i Xf /}- Since (5,/i) is pointwise convergent, one 
can find some Borel subset Z Ao c EX- with p(E Xo ) > such that ||xoS;, ■ ■ ■ S/Jb — > as n — > +00 
for all i. e S Ao . According to Theorem B (precisely, since here p is more general than p p ,p, we 
need Theorem B' and Weak Birkhoff Recurrence Theorem stated in Section 4), one can further 
choose a Borel subset E' c Y, Xo with p(£' Ko ) > such that xq e £ s (j.) for any i. e E' . 

This completes the proof of Proposition 3.2. □ 

Hence, the proof of Theorem A is completed if we recognize the statement of Theorem B. 

3.1.2. A further question related to Theorem A 

To describe the maximal growth rate of the trajectories generated by random products of 
matrices Si, . . . , S^ in S, in [40] G.-C. Rota and G. Strang introduced the very important con- 
cept -joint spectral radius of S -by 

p(S) = lim sup I max ||S/, ■ ■ ■ SJI^" 

It is well known thatp(S) < 1 if and only if 5 is absolutely (uniformly) exponentially stable, i.e., 

n 

lim ]TS (> = d xd Vi.e4; 

C=\ 

see N. Barabanov [3]. We notice that if S is product bounded or, more generally, polynomially 
bounded in R. dxd as in L. Gurvits and L. Rodman [19], thenp(S) < 1. As shown by the example 



S = 



1 

1 1 



p(S) - 1 need not imply the product boundedness of S. 

Let S = (£„)+", where g„ : (Q, & ', P) — > 7C, be a discrete-time, time-homogeneous, station- 
ary (p, i , )-Markov chain as before. Here we ask the following. 

Question 3.3. If 5 is reducible with p(S) = 1 and (5, E) is pointwise convergent then, is (S, S) 
pointwise exponentially convergent? 

3.2. Periodically switched stable sy sterns 

ForS = {Si, . . . ,Sjr} c R dxd , it is caUed "periodically switched stable" [39, 47, 16] if for any 
finite-length words {k\,. . . ,k n ) 6 7C" and n > 1, the spectral radius p(Sk, ■ ■ ■ S^J < 1, i.e., over 
any periodical switching sequences 

i. = (k\, . . . , k n , k\, . . . ,k„,k\, . . ., k„, . . . ), i.e., ij+t„ — kj VI < j < n and 6 > 0, 

we have || n"=i S/Jb — > as « — > +00. 

There are counterexamples which show that the periodical-switched stability need not imply 
the absolute asymptotic stability of 5, namely, || n"=i S17II2 — > as « — > +00 for all i. € E^. See 
[10], also [9, 29, 20]. However, in [16, Main Theorem], the authors proved that S is exponentially 
stable yUp/>-almost surely, if the transition probability matrix P is irreducible, i.e., [i p p is ergodic 
for# + . 

From the ergodic decomposition theorem (Theorem 2.5) and [16, Main Theorem], we can 
easily obtain a more general result as follows: 
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Theorem 3.4. Let S be periodically switched stable. Then the Markovian jump linear system 
(S, S) is exponentially stable V-almost surely; that is to say, 

exponentially fast 

ll%(w)---Sf„( w )|| 2 ■ >0 asn^+oo, 

forV-a.e. u e Q. 

This theorem generalizes the statement (1) of [16, Main Theorem] from ergodic probability 
case to invariant probability case. 

3.3. Consistent stabilizability 

Recall, for instance from [42, 43] in the deterministic situation, that 5 = {Si, ... , S/j] c M. dxd 
is called to be 

• "consistently convergent" if there is a switching sequence i. : N — > 7C such that 

n n 

Ts,, — * Odxd, or equivalently, xTTs, f — * 0\ X d Vx 6 P 1 *'' as n — » +oo; 
e=i i=i 

• "consistently exponentially convergent" if there is a switching sequence i. : N — > 'K such 
that 

1 n n 

1 t — r -| — r exponentially fast 

limsup-logH jjS, v || 2 <0, i.e., |S, V > rfxrf as « -> +oo. 

The random versions of these concepts driven by the Markov chain S = (£„)„> i can be formulated 
as follows. The pair (S, S) is called to be 

• "consistently convergent" if there is measurable set ff cfi with P(O') > such that 

I! 

~[ S ffM -> dxd as n -> +oo, Vw € Q!\ 

• "consistently exponentially convergent" if there exists a measurable set Q" c Q. with 
P(Q") > such that 

n 

n exponentially fast 
Sft( W ) > rfxrf as n -^ +oo, VweO . 

f=i 

In D.P. Stanford and J.M. Urbano [42, Theorem 3.5], it is proved that 5 is consistently con- 
vergent if and only if it is consistently exponentially convergent; more precisely, S is consistently 
convergent if and only if there is finite-length word w = (ki, . . . , k m ) 6 < K m for some m > 1 such 
that the spectral radius p(S^, ■ • • S^ m ) < 1. Also see Z. Sun [43, Proposition 4] and J.-W. Lee and 
G.E. Dullerud [31, Theorem 2]. 

We notice that although the consistent exponential convergence of S implies, from Y. Huang 
et al. [25], that there exists some other (p', P')-Markovian probability p- P ' y p> such that (S, yU p ',p') is 
consistently exponentially convergent, yet it cannot imply the consistent exponential convergence 
of (S, E) in general. This is because Pp>,p', constructed in [25] there, need not equal fi p p that has 
been presented in our situation, and the set of all periodical switching sequences in E^ has 
yUp.i>-measure in general case; see for example, [16]. However, based on the recent work of 
X. Dai [15] we can obtain the following equivalence result. 
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Theorem 3.5. Letp(S) — 1. Then, (S, S) is consistently convergent if and only if it is consistently 
exponentially convergent. 

Proof. From the ergodic theory presented in Section 2, we only need to prove this claim: (S, p p ,p) 
is consistently convergent if and only if it is consistently exponentially convergent. 

Assume (S,p p .p) is consistently convergent. Then by Theorem 2.5, there exists at least one 
ergodic component, say p Pt p(- |*7C,), of p p p such that one can find a Borel set S' c EZ-. with 
p p .p{'L'\'Ki) > satisfying S,-, ■ ■ ■ S, n — > Odxd as n — > +oo for all i. e S'. Then from [42, 
Theorem 3.5], it follows that there is a finite-length word w - (ki,...,k m ) e 'K"' such that 
p(St l ■ ■ ■ S^ ) < 1 . On the other hand, since the component 7C, is closed and communicative, each 
point of .Et- is a density point of fi p p(- \K\), and hence the support of fi p ,p(- \Ki), that consists of 
all its density points, is equal to 2"^- . 

Therefore, it follows from [15, Theorem C] that for p p ,p{- |7C,)-a.e. i. e E^-, 



n exponentially fast 
S, f > dxd as n 



exponentially fast 

This implies that there exists a Borel set L" c Xi with fi Pt p(L") > such that 

n 

exponentially fast 



nexponennany iasi 
S, v — — > dxd as « -> +co V/. e £'' 



So, (S,p Pt p) is consistently exponentially convergent. 

This completes the proof of Theorem 3.5. □ 

Theorem 3.5 is the random version of [42, Theorem 3.5]. We conjecture that this statement 
still holds without the condition p(S) = 1; that is the following. 

Conjecture 3.6. (5, S) is consistently convergent if and only if it is consistently exponentially 
convergent. 



It can be shown by the example S 



5 
2 



V5/2 1/2 
-1/2 V3/2 



that the pointwise and consis- 



tent convergence of S are not necessarily the same. However, both types of convergence of 5 
are equivalent, for the case that S consists of diagonal matrices (proven in D.P. Stanford and 
J.M. Urbano [42]) and for the case that S + is polynomially bounded (proven in L. Gurvits and 
L.Rodman [19]). 

As a result of Theorem 3.5, we can obtain the following simple random version. 

Corollary 3.7. Let S consist of diagonal matrices with p(S) — 1. Then, (S, E) is pointwise 
convergent if and only if it is consistently exponentially convergent. 

Proof. Assume (5, S) is pointwise convergent. Then for xq - (1, . . . , 1) e R 1 ^, there exists a 
measurable set Q t0 c Q with P(O A - ) > such that 



f=i 
Since S is diagonal, there follows immediately that 

7 %M ~* ®dxd as n -> +oo Vw € Q. 



'-to- 

(=1 
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So, (S, S) is consistently convergent and further consistently exponentially convergent from The- 
orem 3.5. 

This proves the statement of Corollary 3.7. □ 

4. Partial stability over almost sure switching sequences 

In this section, we will prove Theorem B in a more general framework that is of independent 
interest for stability analysis of linear switched systems. Hereafter, let 

S: I^M. dxd ; jh->S; 

be a continuous matrix-valued function defined on a separable metrizable space I, where we 
assume 2 < d < +oo and Card(J) > 2. 

We consider the stability and stabilization of the discrete-time linear inclusion/control dy- 
namics naturally induced by S: 

x„ e {x„_iS,}, e j, x e W lxd and n > 1. 

As in [16, 15], we denote by 

1} = [i. : N -> 1} 

the set of all admissible control/switching sequences of S, equipped with the standard infinite 
product topology. For any input (xq, L), where xq e M. lxd is an initial state and i. - (i„X=i e £j 
a control/switching sequence, there is a unique output (x„(xq, i-))^[, called an orbit of S, which 
corresponds to the unique solution of the linear switched dynamics, written also as S, 

x„ - x S;, ■ ■ ■ S,„, x e R lxd and n > 1 

over the switching sequence i. = (in)„=\- If the joint spectral radius of S, introduced by G.-C. Rota 
and G. Strang in [40], 



p(S) = lim sup sup yjlSi, ---S/Jb, 

is less than 1, then ||jc„(:to, L)\\2 — > as n — > +oo for all pairs (*o, i-) 6 R 1Xflf x 2"j directly from 
the definition. If p(S) > 1 then from [ 17], for almost every (related to some extremal probability) 
input (xo, i.), \\x„(xq, i.)\\2 diverges exponentially fast to +oo as n — > +oo. Therefore, the most 
interesting and complicated case is the "neutral type" that holds p(S) - 1 . 

For the neutral type, N. Barabanov [3] proved that if S is irreducible and finite, then one can 
find an "extremal norm" 4 || ■ ||* on M. lxd such that for any xq e R lxrf , there corresponds a switching 
sequence i.{x ) = (/„(xo))S with 

||jc S !iUo) • ■ ■ S,-„( Xo) ||« = ||*o||* V« > 1. 

Such an orbit (x„(xo, i-( x o)))^,=i is called a "|| ■ ||„-extremal orbit" of 5. In V. Kozyakin [29], it is 
proved that if 5 is irreducible and finite, then there is an orbit, or, equivalently an input (xq, i.), 



4 According to [40] and also see [3, 49], for any S = jS,|, £ j c R dxd , a norm | 
if p(S) = sup ieJ ||S,||». In the neutral type case, we have 1 = sup ieJ ||S;||» for any extremal norm || ■ ||, of S. 
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which is extremal in the sense of all extremal norms || • ||„ of S; see Corollary 4.1 below. In 
[10, 9, 29, 33], all these works, for the case of positive 2x2 matrices of a special form, it was 
shown that "extremal orbits" are generated by the so-called Sturmian sequences. And this was 
the key point in all the proofs there. In [50, 29, 34], F. Fabian, V. Kozyakin and Ian D. Morris 
further studied the topological structures of the extremal-norm and the Barabanov-norm sets of 
5, respectively. 

However, in all [40, 3, 10, 9, 50, 29, 33, 34] and elsewhere, there are no descriptions of 
the structure of extremal control/switching sequences of S from the viewpoint of probability 
(Corollary 4.1). Conversely, if i. - (i n )JTi is II ■ ||* -extremal for S in the neutral type case, 
i.e., US,, •••SjJ|* = 1 V« > 1, what is the topological structure of the corresponding || ■ ||„- 
extremal initial-state set {xo 6 ffi : (x„(xq, i-)) n >i is || • ||»-extremalforS}? These are impor- 
tant for study of the asymptotic stability and stabilization of the dynamical system S. 

For this aim, we need to consider the classical one-sided Markov shift transformation defined 
as 



'+ 



: £} -» 2j; i. = (i,XZ ■-» i+i = G»i)£i. 



Under the product topology, 9 + is continuous and surjective, but not one-to-one. 

For the case where S is product bounded in M. dxd , it has been shown in [15, Theorem A'] that 
for any # + -ergodic probability p on Zj, either 

exponentially fast 

||S/, ■ ■ ■ S4H2 > as n — > +oo for ju-a.e. i. e Z T , 

or for any norm || ■ ||* of 5 with ||S,||* < 1 we have 

ll s 4 + i ' ' ' s kJ\* = 1 Vifc > and n > 1 forju-a.e. i. e Ej. 

However, there are no available criteria to check whether a given switching sequence has the 
above property. In addition, for the case that ||S, l+l ■ ■ • S, i+ J|» = 1 V£ > 0, n > 1 for ju-a.e. i., there 
is no further dichotomy decomposition of K lx '' into stable manifold E s and central manifold E c ', 
except in the case where the support of /u is minimal as in [33, Theorems 2.1 and 2.2] for two- 
sided Markov shifts and [15, Theorem D'] for GL(d, C)-cocycles driven by one-sided Markov 
shifts. 

Here, we will mainly prove the following more subtle and general results, which implies 
Theorem B stated in Section 1 .2. 

Theorem B'. Assume that S is product bounded; that is equivalent to say, there is a vector norm 
|| ■ ||* on M. lxd , called a "pre-extremal norm" of S, with ||S,||* < 1 V; e I . Then there hold the 
following two statements. 

(i) To every "recurrent switching sequence" i. - (z«),t=l e -Sj. there corresponds a splitting of 
R lxd into subspaces 

R lxd = E s (i.)®E c (i.), 

which is independent of the norm | • ||», such that 

||jcS f] • ■ ■ S,„|| 2 -» as n -> +oo Vx e E S (L), 

and 

llxS,-, • ■ ■ SJ|. = |W|, Vn > 1 Vx € E c (i). 
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(ii) Additionally, let p be an ergodic measure of 6+ on Ej. Then, for fi-a.e. "weakly Birkhojf- 

X) 

=1' 



recurrent switching sequence" i. — (i n )%= 



lim ^/\\xS h ■■■S/Jb < 1 Vie E s (i.). 

n— »+oo 

ana! 

liminf HxS,-, • • • SJ| 2 > Vx e R lxd \ E S (L). 

n— >+oo 

Here the concepts — "recurrent" and "weakly Birkhoff-recurrent" switching sequences — 
will be precisely defined in Section 4. 1 below. Statement (ii) of Theorem B' shows that over 
almost every weakly Birkhoff-recurrent switching sequences /., for any initial states xq e M. lxd \ 
E s (i.), the orbits (x„(xq, ?'.))£=! of the system S would be far away from the equilibrium 0i x </ as 
time passes. 

Since the closure Cl^+G/.+c I 6 > 0}), for any i. e W{9+) the set of weakly Birkhoff-recurrent 
switching sequences, is not necessarily a dynamics minimal subset of E\ as shown by [15, Ex- 
ample 5.5], Theorem B' is an extension of [33, Theorems 2.1 and 2.2] and [15, Theorem D'] 
from minimal dynamics to non-minimal case. 

4.1. Recurrent switching sequences and proof of Theorem B 

As is shown in Ian D. Morris [33] and X. Dai [15], the recurrence of a switching sequence is 
very important for us to study the stability of linear switched systems. 

First, we recall from [35, 48] that for a topological dynamical system on a separable metriz- 
able space Y 

a point y e T is called to be "recurrent" by T, provided that one can find a positive integer 
sequence n^ /* +oo such that 

T" k (y) — > y as k — > +oo. 

In the qualitative theory of ordinary differential equation, this type of recurrent point is also called 
a "Poisson stable" motion, see, e.g., in [35]. 

Furthermore, y e T is said to be "weakly Birkhoff-recurrent" by T ([51, 15]), provided that 
for any e > 0, there exists an integer N > I such that 

JN-l 

Y, WdT k (y)) > J Vj e N, 

where Ibo>,s) : T — > {0, 1 } is the indicator function of the open ball B(y, s) of radius e centered at 
v in the metric space Y. 

From definitions, it is easy to see that a weakly Birkhoff-recurrent point is recurrent (poisson 
stable), but not vice versa. In particular, for the one-sided Markov shift 8 + : Z^ — > 2"^- where 
7C = [1, . . . ,K}, a switching sequence i. - (i n )^\ £ -St is recurrent if and only if for any L > 1 
there is an increasing sequence n^ /" +oo such that 

(in k +i , ■ ■■, S+l) = (i l , • ■ • . z'l) Vfc > 1, 
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for the topology of 2^ is generated by the cylinder sets; and i. is weakly Birkhoff-recurrent if 
and only if it is recurrent and additionally satisfies 

Card{fc: n k < N} 
hm sup > 0. 

,/v->+co N 

We denote by R(T) and W(T), respectively, the sets of all recurrent points and weakly 
Birkhoff-recurrent points of T. It is easy to see that R(T) and W(T) both are invariant under 
T such that 

W(T) c R(T). 

It is easily checked that every periodically switched sequence is weakly Birkhoff-recurrent 
for the one-sided Markov shift 8 + : Ej — > Et. More generally, we have the following basic 
results. 

Poincare's Recurrence Theorem ([35, Theorem VI3.02], [48, Theorem 1.4]). Let p be an ar- 
bitrary 6 ^-invariant probability measure on Zj. Then, for p-a.e. i. elj, it is recurrent of 6 +. 

Weak Birkhoff-Recurrence Theorem ([51], [15, Theorem 2.3]). Let p be an arbitrary 8 + - 
ergodic probability measure on E j. Then, for p-a.e. i. 6 Xj, it is weakly Birkhoff-recurrent of 

Here is the important property guaranteed by the recurrence. If ff?(i.) — > i. as k — > +oo for a 
subsequence [«a], then 

S '„ (+ i ' ' ' S '„ i+f -* S 'i ' ' ' S 'V as k -* +°° 

in (K dxd , || • || 2 ), for any € > 1. 

Now we are ready to prove Theorem B stated in Section 1 . 

Proof of Theorem B. From the ergodic theory of Markov chains formulated in Section 2, we 
only need to consider the associated system (S,p p ,p), driven by the one-sided Markov shift 
0+ : 2^- — > 2^-. Moreover, from Theorem 2.5, there is no loss of generality in assuming that 
p p p is ergodic. Then, the statement follows immediately from the Weak Birkhoff-Recurrence 
Theorem and Theorem B' . □ 

As a direct consequence of Theorem B', we can obtain the following result, which strengthens 
the statement of [29, Theorem 3], 

Corollary 4.1. Let S — {Si, ... , S/j) c M. dxd be an arbitrary irreducible set. Then, there always 

r+ 

■"K ' 



exists at least one 6+-ergodic probability p* on 2i such that there is a splitting ofM. lxd into weak 



stable and weak central directions 

njlxd 



= Ej\i.) Ef(i.) with < dim E? s (i.) = i^ < d for p t -a.e. i. € E^ 
satisfying that 



lim ^||xS,.---S,„||2<p(5) Vie^f.) 
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and 

\\xS u ■ ■ ■ SjJ|, = p(S) n \\x\\ t V« > 1 and x e Ej c {i.) 

for all extremal norms \\ ■ ||* ofS. Here p(S) is the joint spectral radius ofS. 

Furthermore, ifS.^ = then S has the spectral finiteness property; i.e., one can find at least 
one finite-length word, say S,-, • • ■ S, m , such that p(S) — r/p(S,-, • ■ ■ S, m ). 

Proof. Replacing S with p(S) _1 S if necessary, we may assume p(S) = 1 without loss of gener- 
ality. From [17, Theorem 3.1], it follows that there is at least one ergodic probability p.* such 
that 



1 = lim v/jjS^ ---S/Jb for^.-a.e. i. e2£. 

n— >+oo 

Since 5 is irreducible, it is product bounded from [3]. So, to ju,-a.e. weakly Birkhoff-recurrent 
switching sequences i., their corresponding splittings R 1Xflf = E'(i.) © E c (i.) that are given by 
Theorem B' satisfy the requirement of Corollary 4. 1 . 

The second part of Corollary 4.1 follows immediately from the classical Gel'fand spectral- 
radius formula. This completes the proof of Corollary 4.1. □ 

We note here that since S is irreducible, there always exist extremal norms || ■ ||„ of S in 
Corollary 4.1. 

4.2. A basic dichotomy decomposition theorem 

Here, in a more general framework, we will prove a basic dichotomous decomposition based 
on the well-known Poincare recurrence theorem, by using the idea of "limiting semigroup" due 
to D.J. Hartfiel [21, 22] and F. Wirth [49]. However, instead of the whole limiting semigroup 
S°° generated by S, we consider only a limiting semigroup over a switching sequence as done 
in I.D. Morris [33]. Moreover, different with [33] the switching sequence considered here is not 
necessarily minimal. 

Now, our basic decomposition theorem can be stated as follows: 

Theorem 4.2. Let T: Y — > Y be a continuous transformation of a metrizable space Y Let 
A : Y — > K be a continuous family of matrices andy € Y a recurrent point ofT. If there is a 
constant j3 y > 1 satisfying 

l|Ar(ra,y)|| 2 <A V«>1, 

then there corresponds a splitting ofW. lxd into subspaces 

m. lxd = E s (y)®E c (y) 

and a positive integer sequence n^ S +oo with T nk (y) — > y, such that 

lim ||xA r (Hfc,y)lb = Vx e E s (y) 

k—>+co 

and 

A T (n k ,y) \E c (y) -> Id R ix<* \E c (y) as k -» +oo. 
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Here the cocycle Aj{-, •) is defined by 

A T (n,y)=A(y)---A(T n - 1 (y)) 

for any n > 1 and all y e T. 

We notice here that for any recurrent point y of T, we cannot guarantee that 

liminf \\xA T (n,y)\\ 2 > Vie R lxd \ E s (y) 

in the statement of Theorem 4.2, since we are not sure that the decomposition is unique and that 
there exists a norm || • ||» so that ||A(y)||» < 1 for all y e T except the case driven by the one-sided 
or two-sided Markov shift. 

Proof. For any recurrent point y of T, put 

S(y) = \ B e R dxd \ 3n k / +oo s.t. T" k (y) -> y and lim A T (n k ,y) = B 

k—>+co 

Since the cocycle Aj{-, y) is uniformly bounded and the point y is T-recurrent, S{y) is not empty 
and bounded in R dxd . We further claim that it is a compact semigroup in the sense of matrix 
multiplication. 

Firstly, let B = limf^ +co Be where Be 6 S(y). Then for any £ > 1, one can choose n^ > I 
satisfying 

dist(r% iy\y) < 1 and ||A T (^,y) - B/|b < ^f 



So, B e iS(y). This implies that S(y) is closed and hence compact in the space (R , || ■ H2) 

(1) C 

i y k / +00 and n^ 



Secondly, let B\, B2 e S(y). Then one can find two sequences n\ / +00 and n\ / +00 



such that 



r n * ft) -» y. MW.y) -* «i and r n * (y) -> y, A r (n^,y) -» B 2 as *• -> +00. 

To show BiBi 6 ^(j), it suffices to prove that for any N > 1 and e > 0, there is some n> N such 
that 

dist(r"(v),y) < s and ||A r (n,;y) - fi 2 -Bi|| 2 < s. 

In fact, there first exists some k > N such that 

dist (rP(y),y) < I and \\B 2 A T (4\y) - B 2 Bi|| 2 < |. 

Then for the taken k, there is some K' > N such that for any k! > K', 

\\A T {nf},y)A T (n^,y)-B 2 A T (n^,y)\\ 2 < " 



3 

Secondly, since r"*' (y) converges to y as k' — > +00 and Ar(-,)') is uniformly bounded, from the 
continuity of Aj{n, •) one can find some k' > K' such that 

((1) (2) (1) \ E 

H(r^(y)),2^(y))<| 
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\\A T {nf,y)A T {n^\T^{y))-A T {nf,y)A T {n^\y)\\ 2 < |. 

Because for n = n k + n k , we have 

\\A T (n,y) - B2S1II2 < \\B 2 A T (n[ l \y) - B 2 B X \\ 2 + \\A T (n^,y)A T (n^\y) - B 2 A T (n^,y)\\ 2 

+ \\A T (nf,y)A T (4\ T n f(y)) - A T {nf ,y)A T {n ( k Y) ,y)\\ 2 
< s 

and 

dist(r B Cy),y) < dist {t^\t^ (y)), T""\y)\ + dist (T""\y),y) < s 

we obtain that B 2 B\ £ S(y) and similarly B\B 2 e S{y). Thus, S(y) is a compact semigroup. 
Then, S(y) contains an idempotent element P, i.e., P 2 - P (see, e.g. [24]). Next we define 

E s (y) = the kernel of P(-) and E c (y) = the range of P(), 

where P(-) : R lxd -> R lxd is defined by x t-* xP. Then 

R lxd = E s (y)®E c (y). 

Since Pis an w-limit point of the sequence {Ar(n,y)}^[, there is a subsequence {«&}£?! such that 
Ar(w&,}') — > -P as A: — > +00. This implies that 

lim xAT(tik,y) = 0i xi jVx € E s (y) and lim jcAr(H*,y) = x V;c e E c (y), 

k^>-\-oo k— >+oo 

This thus proves the statement of Theorem 4.2. □ 

A special case of Theorem 4.2 is the following statement. 

Corollary 4.3. Let T : T — > T fee a continuous transformation of a metrizable space Y having a 
recurrent point y. Let A : T — > IR''*'' fee a continuous family of matrices satisfying 

\V^T{n,y)\\ 2 < By V« > 1, for some constant By > 1. 

IfE s (y) = {0 lxd }, then 

A-T(nk,y) — * Id R ixrf as k — > +00 

/or some sequence nk — > +00. 

We have the following two remarks about the important Theorem 4.2: 

Remark 4.4. Theorem 4.2 may not be true if i. : N — > I~ is not a recurrent switching sequence of 
S. For example, letS = {So, Si), where HS0II2 < 1 an d Si = ld R dxd is the identity matrix. Clearly, 

5 is product bounded. However, for the non-recurrent switching sequence i. : N — > {0, 1} where 
i\ - and i„ = 1 for all n > 2, we have 



lim .JcS,-, ■ ■ ■ S; = xSo Vx e 



>lX</ 



which implies that the statement of Theorem 4.2 is not true if So + Odxd- 
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Remark 4.5. It is natural to ask whether the convergence is exponentially fast over the stable 
manifold E\L); that is, 



limsup - log ||xS;, ■ • • S,J|2 < 0, 

n— >-t-oo H 

The following example shows this may not be true. 
Example 4.6. LetS = {S , Si) with 



Vx € E s (i). 



So 



1 
1 



and S 



a 
1 



where < a < 1 . We now construct a recurrent switching sequence by induction. For a word 
w = (if- ik) e {0, l} k , let \w\ - k denote the length of the word w and Ok stand for the word 
consisting of k numbers of 0, i.e, Ok - (0, . . . , 0) e {0, 1}*. For any pair w\ = (i\, . . . , ik) and 
w 2 = (i\ ,..., i'J, put w! w 2 = (ri, . . . , i k , »*„..., i'J e {0, 1 } k+m 
Let (j\ = (1), o"2 = (chOio-^ct!). Inductively, for « > 2, let 

cr„ = (cr n -iO lo . 1 pcr„_ 1 ) and i. = lim cr„. 

It is easy to see from the construction that i. is a recurrent switching sequence of S and 

JR lx2 = E s (i.) e E c (i.) where £'(/.) = {(xi, 0) | jci e R) and £ c (/.) = {(0, x 2 ) \ x 2 e K}. 
A routine check shows that 



limsup-logHxS,! • • -S 

n— >+co W 



4,112 = lim - log a = Vie E s (i.) \{0 lx2 } 



So the convergence is not exponentially fast over the switching sequence /.. 

In Section 4.3 below, we will further consider the regularity of the stable manifold E"(y) and 
prove that restricted to it, \\Aj(n,y) \E s (y)\\ 2 converges exponentially fast to as n — > +oo if, in 
addition, y is a weakly Birkhoff-recurrent switching sequence. 

4.3. The measurability of the stable manifolds 

For < p < d, we let 5f (p, M. lxd ) denote the set of all p-dimensional subspaces of R lx '' and 



§f(R lxo ') = |Jp=o^O'' RlXfl ')> where U means the disjoint union. We equip ^(M} xd ) with the 
compact topology induced by the Hausdorff metric dn(-, ■), i.e., for any Klfe ^(M. lxd ), 



d}i(V, W) — max < sup inf ||v - w\\ 2 , sup inf ||w - v\\ 2 \ where V^ = {v 6 V: \\v\\ 2 = 1). 

l veVl weW» lre wl''^ J 

Here || • H2 is the euclidean vector-norm on R lxd as before. 

Let S: _T 3 / 1— > S, e M. dxd be a continuous matrix-valued mapping defined on a topological 
space I . For any i. — (in)„=i G ZJ, we set 



E s (i.) = {x € 



>lxd 



xS; 



■ S,„ — > 0i X rf as n — » +00} 
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It is a subspace of P 1Xfll with S^ (E s (i.)) c E s (i.+i) and called the "stable manifold/direction" 
of S over the switching sequence i. - (i n )^[- Now, we will consider the measurability of the 
following functions 

ZJ 3 i. ^ E s (i.) e &(R lxd ) and 1} 3 i. ^ dim£ s (/.) e Z + . 

For that, we need the following lemma, which is a direct corollary of the classical Oseledec 
multiplicative ergodic theorem (see [37] and also [48, Theorem 10.2]). 

Lemma 4.7 (Oseledec). Let T : (Q, J£\ P) — > (Q., # ', P) be an ergodic measure-preserving trans- 
formation of a probability space (Q, & ', P). Let A: Q. — > M. dxd be a measurable family of matrices 
satisfying 

log + ||A(-)|| 2 e L l (£l, 3?, P), where x + = max{0, x). 

Then, there exists Q! e & with T(£l') C £2' a«iiP(fi') = 1 having the following properties. 

(1) There exists a measurable function u i— > V' 5 (w) € r ^(R lxd ) and an integer < ip < d with 
dim V s (w) = i v for all w e Q', i.e., V s (oj) e <g(i F ,R lxd ). 



(2) If w 6 Q' then 



and 



X(oj,v) - Um -log||vA r («,w)||2 < Vv e y s (w) 



Xito, v) = lim - log ||vA r (n, w)|| 2 > Vv e R lxd \ V((o). 



Here the cocycle 



for any n>\ and all a> € fl 



A T {n,u)=A{u))---A(T n - l u) 



If E\i.) - V s (i.)a.e. for S, then the desired measurability holds. From the following theorem, 
this is the case under an additional condition — product boundedness. 

Theorem 4.8. Let T : (Q, & , P) — > (Q, J^ ', P) be an ergodic measure-preserving continuous 
transformation of a Borel probability space (Q, & ', P) based on a separable metrizable space Q. 
Let A : Q. — > R dxd be a continuous family of matrices satisfying 

\\Ar(n, co)\\2 < B V« > 1 and uc!!, for some constant B > 1 . 

Then there exists Q' 6 & with T(fi') C Q' a«c/P(Q') = 1 having the following properties. 

(1) There exists a measurable function a> i-» V' 5 (w) e ^(P 1 ^) anaf an integer < ip < a? with 
dim V"(a>) s i P /or a// w e O'. 
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(2) Ifco 6 Q' ffte« 

^(oi, v) = lim - log ||vA r (n, oj)\\ 2 < v e V^w) 

n— >+oo 77 



and 



X(co, v) = lim - log ||vA r (n, w)|| 2 =0 v e R lxd \ V\u). 

n— >+°° n 

(3) Tjf a) belongs to Q', f/zen 

liminf ||vA r (n, w)|| 2 > Vv e R lxd \ V s (oj). 

n— >+oo 

This theorem will be proven later. We first note here that if S = {S,}, e j c M. dxd is product 
bounded then from, e.g., [11, 28], there exists a pre-extremal norm || ■ ||» on M. lxd , i.e., ||S,-||» < 1 
for all i € I. This might simplify many arguments as done in [15]. However, in the framework 
of the above Theorem 4.8, there is no such a pre-extremal norm on M. lxd , for the cocycle Aj{-, •). 

Then it is time to prove Theorem B'. 

Proof of Theorem B' . Applying Theorem 4.8 to the situation of Theorem B', we see that 

E\i.) = V s (i.) //-ax. i. e R(6 + ), 

where R(9+) is the recurrent point set. Therefore, combining the Weak Birkhoff-Recurrence 
Theorem, Theorems 4.2 and 4.8 completes the proof of Theorem B'. □ 

Next, we will devote our attention to proving Theorem 4.8. To prove property (3) of Theo- 
rem 4.8, we will need the following simple result. 

Lemma 4.9. Under the situation of Theorem 4.8, for any subspace L c R and any w e fl, 
the following statements are equivalent to each other: 

(a) lim„^ +0O \\A T {n,io) \L\\ 2 = 0. 

(b) liminf„^ +00 \\A T (n,co) \L\\ 2 = 0. 

(c) liminf„^ +0O ||vA r (n, w)lb = OVv e L. 

Proof. We only need to prove (c) => (a). Let e > be arbitrary and then take 5 > so small that 
satisfying max{5/3, 5/3 2 } < s, where /3 is given by product boundedness of Aj as in Theorem 4.8. 
As 1} = {v e L: \\v\\i = 1} is compact and vAj(n, w)) is continuous with respect to v € Z-", it 
follows, from (c), that one can find some integer N > 1 such that ||vAr(jV, oOlb < 5/3 Vv e L*. 
Then for any n > N,we have ||A7-(n, <u)[L||2 < S/3 2 < s. 

This completes the proof of Lemma 4.9. □ 

We now continue the proof of Theorem 4.8. 
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Proof of Theorem 4.8. First it easily follows, from Lemma 4.7, that there exists Q! e & with 
r(Q') c Q' and P(Q') = 1 having properties (1) and (2) of Theorem 4.8. 
For any a> e Q, define the subspace 



E s AT {(x>) = \x e R lxd : lim \\xA T (n, (o)\\ 2 = o] 



From Lemma 4.9 with L = span{x), x e E A T {co) if and only if lim inf„^ +00 ||jtA7-(n, a»)||2 = 0. It 
is easily checked that for all a> e £2', 

lim \\A T (n, oS) \E S A T (co)\\ 2 = 0, A(cj)(E* a r («)) £ £* r (r(<u)) and W) C £* T (u>). 

Next, we will prove that dim£^ T {co) = constant for a.e. u> e Q. At first, for any a> e Q', since 
xA(uj) - Oixd implies x e V s (oS), the following lemma comes immediately from Lemma 4.7. 

Lemma 4.10. Under the situation of Theorem 4.8, for any a> e Q', it holds that 

dhnE s AT (T"(u))) = dim E s AJ (af) 

for each n > 1. 

For the Borel probability space (Q, & ', P), let JP P be the "P-completion" of &, as the cr-field 
J^" p = cr(jF U <Ap), where ,Ap denotes the class of all subsets of arbitrary P-null sets in &. 
Then P on & has a unique extension to the cr-field 3? r and T : (Q, J*" p , P) -> (Q, 3® ', P) is also 
an ergodic measure-preserving transformation. This completion enables us using some classical 
results in measure theory. 

Lemma 4.11. Let (Y, J^V) be a Borel measurable space. Then a function 

is ^ v -measurable if and only if there exists some & -measurable function g: Q. — > Y satisfying 
f(ai) = g{a>)for V-a.e. a> e Q. 

This result is well known and can be found in many textbooks on real analysis and probability, 
for example, in P. Billinsley [8]. The following is an other classical result needed. 

Lemma 4.12 (Projection and Sections, Lusin, Choquet, Meyer; see [27, Theorem A1.4]). Let 
(Y, &y) be a Borel measurable space and n: D. X Y — > D. the projection defined by (w,y) h > to. 
Then for any B e & ® & Y , 

(i) n{B) belongs to ,^ ¥ ; 

(ii) there exists a JP -measurable element tj: D, — > Y such that {to, rj(a>)) € BforF-a.e. on n{B). 

For any 1 < p < d, let 

g p :£lx ^(p, M. lxd ) -» [0, oo); (a, L) i-> lim inf ||A r (n, of) \L\\ 2 

n— >+oo 

and 

^:Ox%,R w )-»0; (a>,L)^a>. 
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Moreover, set 

n J , = QTiff p ( g ; 1 {0}). 

Although g p is Borel measurable and so the pre-image g„'{0} is a Borel subset of the product 
space Q x &(p, R lxd ), yet the projection Q p need not belong to the Borel cr-field & of Q. 

Lemma 4.13. Under the situation of Theorem 4.8, for if < p < d, £l p is such that T(Q. p ) C Q p 
and Q. p e J^ p , where ip is the stable index given by Lemma 4. 7. 



Proof of Lemma 4.13. Let ip < p < d. We note that for any a> e Q. p , from Lemma 4.7 one can 

-l 
p 

dim(V s (r(w)) + A(w)(L)) > p, 



always find some L e @(p, R lxd ) with V s {u>) c L such that (w, L) e ^"'{O}. Then 



which implies that there is some M e <&(p, R lxd ) with M C V^TXw)) + A(w)(L). This means that 
(T(u>),M) G gp'fO) and hence r(w) e Q p . So, the invariance holds. The measurability comes 
from Lemma 4.12. This proves Lemma 4.13. □ 

Since P is T-ergodic, P(Q p ) = 1 or for any ip < p < d. It is easily checked that P(fl^) = 1. 
Let i p be the maximal integer p such that P(Q p ) = 1. Then from Lemma 4.12, we could obtain 
the following 

Lemma 4.14. Under the situation of Theorem 4.8, one can find a 3 ' -measurable element 

n: Q^ S?(ip,R d ) 
such that 

(to, t](co)) € g^{0} and T](co) = E s AT (co) 

forV-a.e. to e Q.y . 

This, combining with Lemma 4. 1 1, implies that there exists a immeasurable element, written 

as 

t.n^m P M d ), 

such that 

f (to) = E s AT (to) for P-a.e. weQ. 

Clearly, ip < i P . To complete the proof of Theorem 4.8, it is sufficient to prove ip = i p . This case 
comes immediately from the following. 

Lemma 4.15. Under the situation of Theorem 4.8, the following limits exist and 

lim -log\\A T (n,a>)\E AT (o>)\\ 2 <0 

n— >+oo fi ' 

forF-a.e. co € Q. 
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Proof of Lemma 4.15. As the section £, defined above, is Borel measurable, from Lusin's theo- 
rem it follows that there is a closed subset E c Q' with P(E) > such that 

CO ^ £(w) = E at (oj) 

is continuous on E. Moreover, from the Birkhoff ergodic theorem, it follows that there is a 
T-invariant Borel subset Q." c Q' with P(Q") = 1 such that 

1 n_1 
f (w) = E S A T (to) and lim - V l E (T'(co)) = P(£) 

H— j+oo /7 ^- — ' 
;=0 

for any a> e O", where LjQ is the indicator of E defined on O. 

Let < s «: 1 be an arbitrary constant. Similar to the proof of Lemma 4.9, one can take, by 
the continuity of i; restricted to E, some integer N > 1 sufficiently large such that 

\\A T (N, a)) \E s AT {cS)h <£ Vwe£. 

In what follows, let u> e Q" be arbitrarily given. Then, there is some integer £& » N such that 

Y,h(T'(cb))>j Vy>l. 

This implies that for any j > 1 one could find j integers, say k\ , . . . , kj, such that 
< k x < /c 2 < ■ ■ ■ <kj < jtco-l and T l <(to) eE f or 1 < s < j. 

As j is big sufficiently, we can choose at least [j/N] integers, say kj l , . . . , kj ljlm , from {Jq, . . . , kj}, 
such that 

o < h <h<---< hum ^ i { o - l 

£/,_, +N< k js for 2 < s < [j/N] 



and 



T l '°{6S)eE for 1 < s < [j/N], 



where [j/N] = max{« e Z\n < j/N}. Therefore, 

lim sup - log \\A T (n, a)) \E s A j(a))\\ 2 = lim sup — log \\A T (j{ & , G>) \E A j(a))\\ 2 

= lim sup — log \\A T (j€& + N, cb) \E s AT {{b)\\ 2 

< lim sup ^- {loge^ 1 + log/? 1 ^ 1 } 

= log(fi/3) 

<0 

because e > is arbitrary. Hence, E A T {cb) = V s (a>) for any at e Q". 

This proves Lemma 4.15. □ 

Now, the statement of Theorem 4.8 follows immediately from Lemmas 4.7, 4.9 and 4.15. 
Thus, the proof of Theorem 4.8 is completed. □ 
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4.4. A remark to Theorem B' 

Why do we only consider yu-a.e. i. e W(9 + ), not every i. e W{9 + ), in statement (ii) of The- 
orem B'? The reason is this: although the recurrence of a weakly Birkhoff-recurrent switching 
sequence i. - {i n )„T\ is so strong that having a positive recurrent frequency, yet the stable man- 
ifold E s (i. +tl[ ) need not approximate sufficiently E s (i.) even i. +nr converges to i. as I — > +oo, 
because the splitting E s (i.) © E c (i.) of M lx '' defined by statement (i) of Theorem B' is not nec- 
essarily continuous with respect to i. e R(9+). This is just one of the essential hard points of 
nonuniformly hyperbolic systems. 

In light of this reason, we have to apply the Oseledec multiplicative ergodic theorem to 
obtain a weak regularity — the measurability of E"(i.), with respect to p-a.e. i. e Zj, as done in 
Section 4.3. 

However, if E"(i.) = R lxd , then E s (i.+i) - R lxd for all ( > 1. And the above short point is 
naturally avoided in this case. So, as done in the proof of Lemma 4. 15 that is independently inter- 
esting, together with Theorem 4.2, we can easily obtain the following, which is the counterpart 
of Corollary 4.3. 

Corollary 4.16 ([15, Theorem 2.4]). Let T : O — > Q, be a continuous transformation of a sepa- 
rable metrizable space Q.. Let A: Q. — > M. be a continuous family of matrices satisfying 

||Aj-(«, (jj)||2 < B Vn > 1 and a> € £1 for some constant B > 1. 

If co e W(T) satisfies E s AT (co) — M. lxd , then \\Aj{n, co)\\2 converges exponentially fast to as 

n — > +oo. 

Finally, for the convenience of our subsequent papers, we reformulate Theorem B' as follows: 

Theorem B". Let T : (Q, & ', P) — > (Q, & ', P) be an ergodic measure-preserving continuous 
transformation of a Borel probability space (Q, J? ', P) based on a separable metrizable space Q. 
Let A : Q — > R'' x '' be a continuous family of matrices satisfying 

\\Aj(n, co)\\2 < B Vn > 1 and co e Q,, for some constant B > 1 . 

Then there hold the following two statements. 

(1) To every recurrent point a) 6 R(T), there corresponds a splitting o/]R lxrf into subspaces 

R lxd =E s (uj)®E c (aj), 
and a positive integer sequence n\ /* +oo with T nk {oS) — > to, such that 

lim \\A T (n k ,(o)\E s ((o)\\ 2 = 

k— >+co 

and 

A T {nk,cS) \E c {lS) — > Id R ixd \E c (<jl>) ask — > +oo. 

(2) ForF-a.e. weakly Birkhoff-recurrent point a> e W(T), 



lim i/\\xA T (n,aj)\\ 2 < 1 Vx e E\oj) and liminf \\xA T (n, a>)\\ 2 > Vjc 6 R lxd \ E s {u) 
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5. Concluding remarks 

For a Markovian jump linear system, we introduced two concepts — pointwise convergence 
and pointwise exponential convergence. The latter is expected in many aspects, like numerical 
computation, optimization control and so on. These two kinds of stabilizabilities are not equiv- 
alent to each other, in general. However, we showed that if the Markovian jump linear system 
is product bounded, then the pointwise convergence and pointwise exponential convergence are 
equivalent to each other. 
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